Monitoring camera system

ABSTRACT

In a monitoring camera system, a master device registers a smart phone and a wireless router therein in advance. If sensor detection information is received from a human sensor, the master device requests a monitoring camera to transmit image/audio data, and sends image/audio data transmitted from the monitoring camera to the smart phone via the wireless router. The smart phone displays the image data sent from the monitoring camera on a touch panel.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a monitoring camera system whichperforms data input and output to and from a camera.

2. Description of the Related Art

There is a monitoring camera system which monitors an intruder whoenters a house lot (for example, refer to Japanese Patent UnexaminedPublication No. 2007-323533). The monitoring camera system disclosed inJapanese Patent Unexamined Publication No. 2007-323533 transmits amonitoring result to a center side by using a dedicated monitoringsystem.

SUMMARY OF THE INVENTION

However, in the monitoring camera system disclosed in Japanese PatentUnexamined Publication No. 2007-323533, a dedicated system is necessary,and thus a lot of labor and cost are required to introduce a monitoringsystem.

An object of the present invention is to provide a communication systemwhich can monitor an intruder who enters a house lot without introducinga dedicated system.

According to the present invention, there is provided a monitoringcamera system including a monitoring camera; a master device thatcommunicates with the monitoring camera, and is connected to a fixedtelephone network so as to perform calls with other fixed telephones;and a mobile phone terminal that includes a display/input unit, performswireless communication with the master device by using a wirelessrouter, and is connected to other mobile phones via a mobile phonenetwork, in which, in a case where the mobile phone terminal isregistered, the master device registers the mobile phone terminal as aslave device when there is a vacancy in which a slave device can beregistered, and registers the mobile phone terminal so as to be limitedto a security function when the vacancy is not present, in which, whenan operation of giving an instruction for image display is received, theregistered mobile phone terminal transmits information regarding theoperation to the master device via the wireless router, and in which themaster device transmits image data transmitted from the monitoringcamera to the registered mobile phone terminal via the wireless routeraccording to the information regarding the operation.

According to the present invention, it is possible to provide amonitoring system which is convenient to use at low cost by using anexisting fixed telephone.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating a system configuration of a monitoringcamera system of the present embodiment;

FIG. 2 is a block diagram illustrating an internal configuration of amaster device;

FIG. 3 is a block diagram illustrating an internal configuration of aslave device;

FIG. 4 is a block diagram illustrating an internal configuration of acamera;

FIG. 5 is a block diagram illustrating an internal configuration of asensor;

FIG. 6 is a block diagram illustrating an internal configuration of asmart phone;

FIG. 7 is a diagram illustrating an initial screen of the smart phoneduring activation;

FIG. 8A is a diagram illustrating transition of a screen when volume ofa microphone and a speaker is set;

FIG. 8B is a diagram illustrating transition of the screen when volumeof a microphone and a speaker is set;

FIG. 8C is a diagram illustrating transition of the screen when volumeof a microphone and a speaker is set;

FIG. 9A is a diagram illustrating transition of the screen of the smartphone when a hands-free call is performed;

FIG. 9B is a diagram illustrating transition of the screen of the smartphone when a hands-free call is performed;

FIG. 9C is a diagram illustrating transition of the screen of the smartphone when a hands-free call is performed;

FIG. 10A is a diagram illustrating transition of the screen of the smartphone when a handset call is performed;

FIG. 10B is a diagram illustrating transition of the screen of the smartphone when a handset call is performed;

FIG. 10C is a diagram illustrating transition of the screen of the smartphone when a handset call is performed;

FIG. 11A is a diagram illustrating transition of the screen of the smartphone when telephone monitoring is performed;

FIG. 11B is a diagram illustrating transition of the screen of the smartphone when telephone monitoring is performed;

FIG. 11C is a diagram illustrating transition of the screen of the smartphone when telephone monitoring is performed;

FIG. 12 is a sequence diagram illustrating a flow of an operation of themonitoring camera system;

FIG. 13 is a flowchart illustrating an operation procedure of the masterdevice;

FIG. 14 is a sequence diagram illustrating a flow of initial setup ofthe monitoring camera system;

FIG. 15 is a diagram illustrating a screen displayed before an initialsetup operation of the smart phone is started in the initial setup;

FIG. 16 is a diagram illustrating a screen displayed during an initialsetup operation of the smart phone in the initial setup; and

FIG. 17 is a diagram illustrating a menu display screen of the smartphone when an operation is started.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

With reference to the drawings, a description will be made of anembodiment (hereinafter, referred to as “the present embodiment”) of amonitoring camera system related to the present invention. In thefollowing present embodiment, as an example of a communication systemrelated to the present invention, an exemplary monitoring camera systemwill be described. The present invention is not limited to acommunication system, and may be represented as each of devicesconstituting the communication system, a method for each device, and aprogram.

FIG. 1 is a diagram illustrating a system configuration of monitoringcamera system 5 of the present embodiment. Monitoring camera system 5 ismainly provided in house 8, and includes master device 10, two slavedevices 20A and 20B, two cameras 30 (specifically, indoor camera 30A andmonitoring camera 30B), various sensors 40 (specifically, human sensors40A and 40B, smoke sensor 40C, and opening/closing sensor 40D),smartphone 50 (portable terminal), and wireless router 60. Aconfiguration of monitoring camera system 5 is only an example and maybe modified in various aspects.

Master device (gateway) 10 is a control device which controls the entireoperation of monitoring camera system 5, and is connected to the slavedevices, the cameras, the sensors, and the like in a communicable mannerby using a communication method such as digital enhanced cordlesstelecommunications (DECT). Master device 10 is connected to the Internet65 (network) via wireless router 60 using a wireless LAN. Master device10 is connected to fixed telephone network 85 in a wired manner and canperform a call to fixed telephone 80. Master device 10 has a function ofcharging slave device 20A which is inserted into insertion port 10 a.

Slave devices 20A and 20B are connected to master device 10 in the DECTcommunication method and can perform a call to master device 10.Particularly, in a case where two slave devices 20A and 20B are notrequired to be differentiated from each other, the slave devices arecollectively referred to as slave device 20.

Various sensors 40 (specifically, human sensors 40A and 40B, smokesensor 40C, and opening/closing sensor 40D) are connected to masterdevice 10 in the DECT communication method. Herein, as sensors,opening/closing sensor 40D which detects opening and closing of awindow, smoke sensor 40C which detects smoke, and human sensors 40A and40B which detect a person with infrared rays are used. Particularly, ina case where the sensors are not required to be differentiated from eachother, the sensors are collectively referred to as sensor 40. As will bedescribed later, infrared sensor 313 (refer to FIG. 4) built into camera30 is also used as a human sensor.

The two cameras (specifically, indoor camera 30A and monitoring camera30B) have a call function and are connected to master device 10 in theDECT communication method. Herein, as cameras, monitoring camera 30Bwhich captures an image of an outdoor environment, and indoor camera 30Awhich captures an image of house 8, are used. Particularly, in a casewhere the cameras are not required to be differentiated from each other,the cameras are collectively referred to as camera 30.

Smartphone 50 is connected to master device 10 via wireless router 60using a wireless LAN, and is connected to mobile phone 70 or othersmartphones via mobile phone network 75 using a communication methodsuch as the third generation (3G) method.

FIG. 2 is a block diagram illustrating an internal configuration ofmaster device 10. Master device 10 includes control unit 109, storageunit 103, operation unit 105, and display unit 106. Master device 10receives various input operations and displays information such as animage on display unit 106. Control unit 109 has call control portion 110and audio stream processing portion 112 built thereinto, and performscall control during calling, processing of audio data, and the like.

Master device 10 includes image memory control unit 115 and image memory116, and stores image data or the like captured by camera 30 in imagememory 116.

Master device 10 includes wireless LAN control unit 121 and wireless LANcommunication I/F unit 122, and transmits and receives image data andaudio data to and from smartphone 50, camera 30, and the like viawireless router 60 connected over a wireless LAN.

Master device 10 includes DECT protocol control unit 108 and DECTwireless I/F unit 107, and performs wireless connection to slave device20, sensor 40, and camera 30 by using a wireless method such as digitalenhanced cordless telecommunications (DECT).

Master device 10 includes audio bus 117, sound input/output control unit104, speaker 129, and microphone 128, and performs input and output ofsound to and from an external device.

Master device 10 includes fixed telephone line I/F unit 101, and canperform a call to external fixed telephone 80 connected to fixedtelephone network 85.

Master device 10 includes slave device/portable terminal charging unit126 and charges slave device 20 or smartphone 50 inserted into insertionport 10 a.

Master device 10 includes USB communication I/F unit 127, and transmitsand receives data to and from an apparatus, a memory, or the like havingan interface of a universal serial bus (USB) standard.

Master device 10 registers various sensors 40 (specifically, humansensors 40A and 40B, smoke sensor 40C, and opening/closing sensor 40D)and the plurality of cameras 30 in storage unit 103 in correlation witheach other. For example, human sensor 40B and monitoring camera 30B areinstalled at close locations outdoors and are thus registered incorrelation with each other. Monitoring camera 30B, as will be describedlater, integrally has infrared sensor 313 (refer to FIG. 4) which is ahuman sensor and is built thereinto, and is thus also registered incorrelation with infrared sensor 313. Human sensor 40A, smoke sensor40C, and opening/closing sensor 40D are all installed inside house 8 andare thus registered in correlation with indoor camera 30A.

Master device 10 registers smartphone 50 and wireless router 60 thereinin advance. A flow of initial setup performed until master device 10registers smartphone 50 and wireless router 60 therein will be describedlater.

FIG. 3 is a block diagram illustrating an internal configuration ofslave device 20. Slave device 20 includes control unit 247, storage unit242, operation unit 244, and display unit 245. Slave device 20 receivesvarious input operations and displays information such as an image ondisplay unit 245.

Slave device 20 includes DECT protocol control unit 249 and DECTwireless I/F unit 248, and performs wireless connection to master device10, sensor 40, and camera 30 by using a wireless method such as DECT.

Slave device 20 includes audio bus 255, sound input/output control unit243, speaker 252, and microphone 251, and performs input and output ofsound to and from an external device.

FIG. 4 is a block diagram illustrating an internal configuration ofcamera 30. Indoor camera 30A and monitoring camera 30B as examples ofcameras 30 have substantially the same specification as each other.Camera 30 includes control unit 309, storage unit 303, and an operationunit 305. Camera 30 performs an operation related to image capturing andalso receives input operations.

Camera 30 includes DECT protocol control unit 317 and DECT wireless I/Funit 318, and performs wireless connection to master device 10 by usinga wireless method such as DECT.

Camera 30 includes wireless LAN control unit 321 and wireless LANcommunication I/F unit 322, and transmits and receives image data andaudio data to and from master device 10, smartphone 50, and the like viawireless router 60 connected over the wireless LAN.

Camera 30 includes audio bus 307, sound input/output control unit 304,speaker 329, and microphone 328, and performs input and output of soundto and from an external device.

Camera 30 includes image capturing unit 312, image memory control unit316, and image memory 315, and stores image data captured by imagecapturing unit 312 in image memory 315. Image capturing unit 312 has alens and an imaging element (for example, an image sensor such as acharged coupled device (CCD) or a complementary metal oxidesemiconductor (CMOS)).

Camera 30 integrally has infrared sensor 313 which is a passive infrared(PIR) sensor as a human sensor built thereinto. Infrared sensor 313detects the presence of a person by detecting a change in heat (infraredray) generated by the person. Camera 30 includes power source unit 314which is constituted by a commercial AC power source.

FIG. 5 is a block diagram illustrating an internal configuration ofsensor 40. Sensor 40 includes control unit 447, storage unit 442, anddisplay lamp 445. Sensor 40 performs a predetermined detectionoperation, such as turning on display lamp 445, in a case of detecting atarget (for example, an intruder which is also the same for thefollowing description).

Sensor 40 includes DECT protocol control unit 449 and DECT wireless I/Funit 448, and performs wireless connection to master device 10 by usinga wireless method such as DECT, and sends sensor detection informationto master device 10 when a target is detected.

A sensor unit 453 differs depending on the kind of sensor 40. Forexample, in a case of human sensors 40A and 40B, sensor unit 453 is aPIR sensor which detects a person through a change in infrared rays. Ina case of opening/closing sensor 40D which detects opening and closingof a window or the like, sensor unit 453 is a reed switch which switchesbetween turned-on and turned-off states due to opening and closing. In acase of smoke sensor 40C, sensor unit 453 is a light emitting/receivingunit which detects smoke when emitted light is blocked by the smoke.

A rechargeable battery 450 is a battery which can be charged andsupplies power to each unit.

FIG. 6 is a block diagram illustrating an internal configuration ofsmartphone 50. Smartphone 50 includes control unit 506, storage unit504, and display/operation unit (touch panel) 503. Smartphone 50receives various input operations and displays information such as animage on touch panel 503. Monitoring function control portion 514 whichcan set a function of camera 30 is built into control unit 506 as willbe described later. Touch panel 503, which is a display/input unit intowhich a display unit and an operation unit are integrally formed,displays information such as an image or an icon on a screen andreceives a tap operation (or a touch operation) which is performed onthe screen by a user.

Smartphone 50 includes 3G protocol control unit 502 and 3G communicationI/F unit 501, and performs wireless connection to mobile phone 70 orother smartphones connected to mobile phone network 75, by using a thirdgeneration (3G) wireless communication method.

Smartphone 50 includes audio bus 515, sound input/output control unit505, speaker 513, and microphone 512, and performs input and output ofsound to and from an external device.

Smartphone 50 includes wireless LAN control unit 507 and wireless LANcommunication I/F unit 508, and transmits and receives image data andaudio data to and from master device 10, camera 30, and the like viawireless router 60 connected over the wireless LAN.

Smartphone 50 includes USB communication I/F unit 511, and transmits andreceives data to and from an apparatus, a memory, or the like having aninterface of a universal serial bus (USB) standard.

A description will be made of an operation of monitoring camera system 5having the above-described configuration.

First, an operation of smartphone 50 will be described. When a useractivates an application of the monitoring camera installed insmartphone 50, smartphone 50 displays an initial screen.

FIG. 7 is a diagram illustrating the initial screen of smartphone 50during activation. When the application of the monitoring camera isactivated, an image (moving image) 55 captured by camera 30 is displayedat a center of the initial screen of touch panel 503. Camera icon 51,speaker icon 52, mute icon 53, and disconnect icon 54 are displayed onthe screen of touch panel 503 so that a tap operation can be performed.

Camera icon 51 is an icon used to given an instruction for starting ofrecording of camera 30 and to set a function of camera 30.

Speaker icon 52 as an example of mode switching means is an icon used toswitch a volume of speaker 513 mounted in smartphone 50 and is in aturned-on state. When a tap operation is performed on speaker icon 52,speaker icon 52 can switch between a turned-on state and a turned-offstate. Herein, speaker icon 52 is displayed green in a turned-on stateand is displayed white in a turned-off state.

The turned-on state of speaker icon 52 is a state in which a volume ofspeaker 513 is set to be high and is suitable for typical monitoring ora hands-free call (a speaker phone call). In other words, in a casewhere speaker icon 52 is in the turned-on state, a volume suitable forthe hands-free call (speaker phone call) is set in smartphone 50. On theother hand, the turned-off state of speaker icon 52 is a state in whicha volume of speaker 513 is set to be low as if whispered in user's ear,and is suitable for sound monitoring or a handset call. In other words,in a case where speaker icon 52 is in the turned-off state, a volumesuitable for the handset call is set in smartphone 50.

Mute icon 53 is an icon used to switch turning-on and turning-off ofmicrophone 512 mounted in smartphone 50, and is in a turned-on stateduring activation, that is, in an invalid (silent) state of microphone512. When a tap operation is performed on mute icon 53, mute icon 53 canswitch between a turned-on state and a turned-off state. Herein, in thesame manner as speaker icon 52, mute icon 53 is displayed green in aturned-on state and is displayed white in a turned-off state.

Disconnect icon 54 is used to disconnect camera 30 in which characters“disconnect” is recorded, and is in a turned-off state duringactivation, that is, in a connection state.

FIGS. 8A to 8C are diagrams illustrating transition of a screen ofsmartphone 50 when volumes of microphone 328 and speaker 329 of camera30 are set. When a predetermined operation is performed on the screen oftouch panel 503, selection menus for setting volumes of microphone 328and speaker 329 of camera 30 are displayed on the screen of touch panel503.

As illustrated in FIG. 8A, a “Camera Mic Volume” key 56 displayed as aselection menu is a key for setting a volume of microphone 328. A“Camera Speaker Volume” key 57 is a key for setting a volume of speaker329.

When a tap operation is performed on “Camera Mic Volume” key 56, asillustrated in FIG. 8B, the selection menu disappears, and then seek bar58 is displayed on the screen of touch panel 503. When the user movesslider 58 a of seek bar 58 in horizontal directions, a volume(microphone sensitivity) of microphone 328 of camera 30 is changed. Ifthe volume of microphone 328 is determined, and OK button 58 b ispressed, the determined volume of microphone 328 is set in camera 30.

Similarly, when a tap operation is performed on “Camera Speaker Volume”key 57, as illustrated in FIG. 8C, the selection menu disappears, andthen seek bar 59 is displayed on the screen of touch panel 503. When theuser moves slider 59 a of seek bar 59 in horizontal directions, a volumeof speaker 329 of camera 30 is changed. If the volume of speaker 329 isdetermined, and OK button 59 b is pressed, the determined volume ofspeaker 329 is set in camera 30.

Next, a description will be made of various operation modes usingsmartphone 50.

In the present embodiment, smartphone 50 can shift to four operationmodes including a typical monitoring mode, a hands-free call mode, ahandset call mode, and a sound monitoring mode. As described above,right after the application of the monitoring camera is activated,smartphone 50 displays the initial screen (refer to FIG. 7) and is inthe typical monitor mode. An operation of activating the applicationcorresponds to a monitoring instruction as an operation of giving aninstruction for image display. In the typical monitoring mode, soundcollected by microphone 328 of camera 30 are output from speaker 513 ofsmartphone 50 at a high volume, and microphone 512 of smartphone 50 isin an invalid state. In other words, sound of the user are collected bymicrophone 512 of smartphone 50.

FIGS. 9A to 9C are diagrams illustrating transition of a screen ofsmartphone 50 when a hands-free call is performed. When a tap operationis performed on mute icon 53 in the initial screen of FIG. 7, asillustrated in FIG. 9A, mute icon 53 is turned off, and guidance 61 of“Mute OFF” is displayed on the screen of touch panel 503. Then, if theswitching time (here, 0.2 seconds) has elapsed, as illustrated in FIG.9B, microphone 512 of smartphone 50 becomes valid, and the smartphone isswitched to the hands-free call mode. In this hands-free call mode,sound collected by microphone 328 of monitoring camera 30B are outputfrom speaker 513 of smartphone 50 at a high volume, and microphone 512of smartphone 50 becomes valid so that a hands-free call can beperformed with monitoring camera 30B.

In the hands-free call mode, when a tap operation is performed on muteicon 53 again, as illustrated in FIG. 9C, mute icon 53 is turned on, andguidance 62 of “Mute ON” is displayed on the screen of touch panel 503.Then, if the switching time (here, 0.2 seconds) has elapsed, the screenreturns to the initial screen of FIG. 7, microphone 512 of smartphone 50is invalidated, and the smartphone returns to the typical monitoringmode.

FIGS. 10A to 10C are diagrams illustrating transition of a screen ofsmartphone 50 when a handset call is performed. When a tap operation isperformed on speaker icon 52 in the hands-free call mode illustrated inFIG. 9B, speaker icon 52 is turned off, and guidance 63 of “Speaker OFF”is displayed on touch panel 503, as illustrated in FIG. 10A. Then, ifthe switching time (here, 0.2 seconds) has elapsed, as illustrated inFIG. 10B, the smartphone is switched to the handset call mode. In thehandset call mode, sound collected by microphone 328 of monitoringcamera 30B are output from speaker 513 of smartphone 50 at a low volume(a volume in which the sound can be heard when speaker 513 is close to auser's ear), and microphone 512 of smartphone 50 is still valid.Smartphone 50 can perform a handset call to monitoring camera 30B.

When a tap operation is performed on speaker icon 52 in the handset callmode, as illustrated in FIG. 10C, speaker icon 52 is turned on, andguidance 64 of “Speaker ON” is displayed on the screen of touch panel503. Then, if the switching time (here, 0.2 seconds) has elapsed, thescreen returns to the screen illustrated in FIG. 9B, smartphone 50increases a volume of speaker 513 and is switched to the hands-free callmode.

On the other hand, when a tap operation is performed on mute icon 53 inthe handset call mode illustrated in FIG. 10B, mute icon 53 and speakericon 52 are turned on, and, as illustrated in FIG. 9C, guidance 62 of“Mute ON” is displayed on the screen of touch panel 503. Then, if theswitching time (here, 0.2 seconds) has elapsed, the screen returns tothe initial screen of FIG. 7, microphone 512 of smartphone 50 isinvalidated, and smartphone 50 returns to the typical monitoring mode.

FIGS. 11A to 11C are diagrams illustrating transition of a screen ofsmartphone 50 when telephone monitoring is performed. When a tapoperation is performed on speaker icon 52 in the initial screen of FIG.7, as illustrated in FIG. 11A, speaker icon 52 is turned off, andguidance 63 of “Speaker OFF” is displayed on the screen of touch panel503. Then, if the switching time (here, 0.2 seconds) has elapsed, asillustrated in FIG. 11B, the smartphone 50 reduces a volume of speaker513 of smartphone 50 and is switched to the telephone monitoring mode.In the telephone monitoring mode, sound collected by microphone 328 ofmonitoring camera 30B are output from speaker 513 of smartphone 50 at alow volume (a volume in which the sound can be heard when speaker 513 isclose to a user's ear), and microphone 512 of smartphone 50 is stillinvalid.

When a tap operation is performed on speaker icon 52 in the telephonemonitoring mode, as illustrated in FIG. 11C, speaker icon 52 is turnedon, and guidance 64 of “Speaker ON” is displayed on the screen of touchpanel 503. Then, if the switching time (here, 0.2 seconds) has elapsed,the screen returns to the initial screen of FIG. 7, microphone 512 ofsmartphone 50 is invalidated, and smartphone 50 returns to the typicalmonitoring mode.

On the other hand, when a tap operation is performed on mute icon 53 inthe telephone monitoring mode illustrated in FIG. 11B, mute icon 53 isturned off, and guidance 61 of “Mute OFF” is displayed on the screen oftouch panel 503. Then, if the switching time (here, 0.2 seconds) haselapsed, as illustrated in FIG. 10B, microphone 512 of smartphone 50becomes valid, and the smartphone is switched to the handset call mode.

Next, a description will be made of a flow of an operation of monitoringcamera system 5.

FIG. 12 is a sequence diagram illustrating a flow of an operation ofmonitoring camera system 5. Herein, a description will be made of anoperation of monitoring an intruder or the like by using human sensor40B and monitoring camera 30B provided outdoors.

First, if human sensor 40B detects a person present outdoors, adetection signal and sensor detection information are transmitted tomaster device 10 (step S101). If the sensor detection information isreceived from human sensor 40B, master device 10 is wireless connectedto smartphone 50 by using the wireless LAN (step S102), and transmitsthe sensor detection information to smartphone 50 when the connectionhas been completed (step S103A).

Master device 10 requests monitoring camera 30B to transmit image/audiodata (step S103B). If the request for transmission of image/audio datais received, monitoring camera 30B is connected to master device 10 byusing the wireless LAN, and transmits image data captured by imagecapturing unit 312 and audio data collected by microphone 328 to masterdevice 10 (step S104).

If a monitoring instruction is received from the user (step S105-1),smartphone 50 requests master device 10 to transmit the image/audio data(step S105-2). In response to the request for transmission of theimage/audio data from smartphone 50, master device 10 transmits theimage data and the audio data which have been transmitted frommonitoring camera 30B, to smartphone 50 (step S106).

Consequently, smartphone 50 displays the initial screen (refer to FIG.7) and enters the typical monitoring mode. If a tap operation isperformed on speaker icon 52 in the typical monitoring mode in which theinitial screen is displayed (step S107A), smartphone 50 is switched tothe sound monitoring mode (step S108).

On the other hand, if a tap operation is performed on mute icon 53 inthe typical monitoring mode in which the initial screen is displayed(step S107B-1), smartphone 50 transmits the operation information tomaster device 10 (step S107B-2).

If the operation information is received, master device 10 requestsmonitoring camera 30B to perform a hands-free call (step S109). If thehands-free call request is received, monitoring camera 30B turns onspeaker 329 and transmits an acknowledgement (ACK) signal to smartphone50 via master device 10 (step S110).

If the ACK signal is received from monitoring camera 30B, smartphone 50is switched to the hands-free call mode and starts performing a call. Inother words, smartphone 50 transmits the audio data for conversation,collected b microphone 512, to master device 10 (step S111). Masterdevice 10 transmits the received audio data for conversation tomonitoring camera 30B (step S112). Monitoring camera 30B outputs theaudio data for conversation received from master device 10, from speaker329 (step S113).

Transmission of audio data for conversation from monitoring camera 30Bto smartphone 50 is performed in a reverse order. In other words,monitoring camera 30B transmits audio data for conversation collected bymicrophone 328 to master device 10 (step S114). Master device 10transmits the received audio data for conversation to smartphone 50(step S115). Smartphone 50 outputs the audio data for conversationreceived from master device 10, from speaker 513 (step S116).

In a case where the smartphone is switched to the sound monitoring modein step S108 and then a tap operation is performed on mute icon 53,smartphone 50 is switched to the handset call mode.

FIG. 13 is a flowchart illustrating an operation procedure of masterdevice 10. Master device 10 starts this operation with a detectionsignal from human sensor 40B as a trigger. First, master device 10acquires sensor detection information from human sensor 40B (step S1).Master device 10 determines whether or not a request for transmission ofimage/audio data has been received from smartphone 50 (step S2). If therequest has not been received, master device 10 finishes this operation.

On the other hand, if the request for transmission of image/audio datahas been received from smartphone 50, master device 10 transmits imagedata and audio data transmitted from monitoring camera 30B, tosmartphone 50 (step S3).

Master device 10 determines whether or not a request for a hands-freecall or a handset call is made from smartphone 50 (step S4). This callrequest is made by performing a tap operation on mute icon 53 asdescribed above. If there is no request for a call from smartphone 50,master device 10 finishes this operation.

On the other hand, if there is a call request from smartphone 50, masterdevice 10 relays a call between smartphone 50 and monitoring camera 30B(step S5).

Subsequently, master device 10 determines whether or not an instructionfor ending of the call is given from smartphone 50 (step S6). Theinstruction for ending of the call is given by performing a tapoperation on mute icon 53 or a tap operation on disconnect icon 54 asdescribed above. If the instruction for ending of the call is not given,master device 10 returns to the process in step S5. On the other hand,if the instruction for ending of the call is given, master device 10finishes this operation. Master device 10 enters a standby state untilbeing activated with a detection signal from sensor 40 as a triggeragain.

As mentioned above, in monitoring camera system 5 of the presentembodiment, if human sensor 40B detects an intruder (target), sensordetection information is sent to master device 10. Master device 10transmits the sensor detection information sent from human sensor 40B,to smartphone 50, and also sends a request for transmission ofimage/audio data to monitoring camera 30B which is registered incorrelation with human sensor 40B. If an operation of a monitoringinstruction is received, smartphone 50 sends the operation informationto master device 10. Master device 10 sends the image data transmittedfrom monitoring camera 30B, to smartphone 50, according to the operationinformation. Smartphone 50 displays the image data sent from monitoringcamera 30B on touch panel 503, and sends a request signal for starting acall to monitoring camera 30B when receiving a tap operation on muteicon 53. Master device 10 transmits the request signal for starting acall from smartphone 50, to monitoring camera 30B. A call betweensmartphone 50 and monitoring camera 30B is started.

According to monitoring camera system 5, in a case where an intruder isdetected by human sensor 40B, a call between monitoring camera 30B andsmartphone 50 can be performed, and thus it is possible to improveconvenience. Consequently, a home dweller can converse with theintruder, such as directly listening to what is wanted from theintruder.

In a case where speaker icon 52 is turned on, and a high volume suitablefor a hands-free call is set, smartphone 50 is switched to a hands-freecall mode when receiving a tap operation on mute icon 53. Smartphone 50and monitoring camera 30B enter a voice call state. Consequently,switching to a hands-free call can be easily performed.

In a case where speaker icon 52 is turned off and a low volume (a volumein which sound can be heard when speaker 513 is close to user's ear)suitable for a handset call is set, smartphone 50 is switched to ahandset call mode when receiving a tap operation on mute icon 53.Smartphone 50 and monitoring camera 30B enter a voice call state.Consequently, switching to a handset call can be easily performed.

As sensor 40, human sensor 40B may be built into a single casingintegrally with monitoring camera 30B. Infrared sensor 313 which isintegrally built into monitoring camera 30B may be used a human sensor.Consequently, a camera and a sensor are easily correlated with eachother.

Next, a flow of initial setup until master device 10 registerssmartphone 50 and wireless router 60 therein will be described laterwith reference to FIGS. 14 to 16. FIG. 14 is a sequence diagramillustrating a flow of the initial setup. FIG. 15 is a diagramillustrating a screen displayed before an initial setup operation ofsmartphone 50 is started in the initial setup. FIG. 16 is a diagramillustrating a screen displayed during the initial setup operation ofsmartphone 50 in the initial setup. FIG. 17 is a diagram illustrating amenu display screen of smartphone 50 when an operation is started.

Smartphone 50 displays a home icon (not illustrated) as an initialscreen on a screen of touch panel 503 (step S201). In a case where theuser of smartphone 50 operates each apparatus of monitoring camerasystem 5 by using smartphone 50, first, the user performs a tapoperation on the home icon displayed on the screen of touch panel 503 ofsmartphone 50 (step S202).

In this case, in a case where smartphone 50 is not registered in masterdevice 10, smartphone 50 switches the screen of touch panel 503 to ascreen illustrated in FIG. 15 in order to prompt the user to registerthe smartphone (step S203). A message 91 which prompts the user to plugin master device 10 is displayed on the screen illustrated in FIG. 15.

Therefore, if the user plugs in master device 10 (step S204), in a casewhere wireless router 60 is not registered in master device 10, masterdevice 10 is activated in a software AP mode in which master device 10functions as an access point of WiFi (registered trademark), and turnson an light emitting diode (LED) (not illustrated) in a predeterminedcolor (for example, yellow) (step S205).

Then, if the user performs a tap operation on an icon 92 with the samecolor (yellow) as the color of the LED of master device 10 on the screenillustrated in FIG. 15 displayed on touch panel 503 (step S206),smartphone 50 disconnects communication with wireless router 60,switches to a state of waiting for a signal to be transmitted frommaster device 10 in the software AP mode, and changes the screen oftouch panel 503 to a screen illustrated in FIG. 16 (step S207). Message93 which prompts the user to press a setup button on master device 10 isdisplayed on the screen illustrated in FIG. 16.

Therefore, if the user presses the setup button of master device 10(step S208), master device 10 transmits a setup request signal forrequesting transmission of information which is necessary in order toregister wireless router 60, to smartphone 50 (step S209).

If the setup request signal is received, smartphone 50 transmitssmartphone setup information which is necessary in order to performwireless connection in the software AP mode to master device 10 (stepS210). In this case, if the setup request signal is received, smartphone50 may display a screen which prompts the user to enter a password totouch panel 503, and may transmit smartphone setup information if thepassword is entered.

If the smartphone setup information is received, master device 10performs processes which are necessary in order to perform wirelessconnection to smartphone 50 and causes the LED (yellow) to blink (stepS211).

Smartphone 50 receives the smartphone setup information, thentemporarily disconnects communication with master device 10, andperforms wireless connection to wireless router 60. Smartphone 50transmits a setup request signal for requesting transmission ofinformation which is necessary in setup to wireless router 60 (stepS212).

Wireless router 60 transmits router setup information which is necessaryin order to set up wireless router 60 in master device 10 to smartphone50 (step S213).

If the router setup information is received from wireless router 60,smartphone 50 disconnects the communication with wireless router 60,performs wireless connection to master device 10 in the software AP modeagain, and transmits the router setup information received from wirelessrouter 60 to master device 10 (step S214).

Master device 10 registers wireless router 60 therein on the basis ofthe router setup information received from smartphone 50 (step S215),cancels the wireless connection (software AP mode) with smartphone 50after the registration has been completed, performs wireless connectionto wireless router 60 by using the wireless LAN, and causes the LED toblink in predetermined another color (for example, green) (step S216).

If the communication with master device 10 is disconnected, smartphone50 performs wireless connection to wireless router 60 by using thewireless LAN, and transmits smartphone information which is necessary inorder to register smartphone 50 in master device 10, to master device 10via wireless router 60 (step S217). Smartphone 50 may display a screenwhich prompts the user to enter a password to touch panel 503, and maytransmit smartphone information if the password is entered.

Master device 10 registers smartphone 50 on the basis of the smartphoneinformation received from smartphone 50 (step S218), and transmits anotification of registration completion to smartphone 50 via wirelessrouter 60 if the registration of smartphone 50 has been completed (stepS219). At the time when the registration of smartphone 50 is completed,master device 10 outputs beep sound from the speaker (not illustrated)(step S220) and turns off the LED (step S221).

If the notification of the registration completion is received frommaster device 10, smartphone 50 displays the home icon again on thescreen of touch panel 503 (the smartphone returns to states of stepsS222 and S201).

The initial setup (registration of smartphone 50 and wireless router 60)is completed in the above steps S201 to S222, and smartphone 50 canperform communication with master device 10 via wireless router 60.

Consequently, image/audio data which is transmitted from monitoringcamera 30B to master device 10 can be transmitted from master device 10to smartphone 50 via wireless router 60, and thus the user can monitoran intruder who enters a house lot.

In a case where smartphone 50 and wireless router 60 have beenregistered in master device 10 is the above step S201 (or step S222), ifthe user performs a tap operation on the home icon, smartphone 50changes the screen of touch panel 503 to a screen illustrated in FIG.17.

In a case where wireless router 60 has been registered in master device10 in the above step S204, master device 10 does not use the software APmode but performs wireless connection to wireless router 60 from thebeginning, and causes the LED to be turned on (blink) in a predeterminedanother color (for example, green). Consequently, the user performs atap operation not on yellow icon 92 but on green icon 94 in step S206 sothat a registration operation of wireless router 60 is omitted and anoperation in step S217 is performed.

Here, master device 10 may register smartphone 50 as a slave device. Inother words, smartphone 50 can be used as a slave device through aregistration operation in step S217 and the subsequent steps. However, afixed telephone function of master device 10 is equivalent to anexisting fixed telephone function, and, generally, the number (maximumvalue) of smartphones 50 which can be registered in master device 10 ispredefined (for example, up to four phones).

In other words, regarding a fixed telephone function and a monitoringsystem function, an available function differs depending on a differencein the number of registered phones, and the number of registered phonesis small in the fixed telephone function which is frequently used bymaster device 10.

For this reason, in a case where master device 10 registers a newsmartphone 50, it is determined that there is a vacant port in which aslave device can be registered.

In a case where there is a vacant port, master device 10 registerssmartphone 50 as a slave device, and notifies smartphone 50 ofinformation indicating that smartphone 50 has been registered as a slavedevice when a notification of registration completion is sent. In thiscase, smartphone 50 can use both of the fixed telephone function and themonitoring system function.

On the other hand, in a case where there is no vacant port, masterdevice 10 registers smartphone 50 so as to be limited to a securityfunction, and notifies smartphone 50 of information indicating thatsmartphone 50 has been registered so as to be limited to a securityfunction when a notification of registration completion is sent. In thiscase, smartphone 50 can use only the monitoring system function.Information indicating that a telephone function (Phone) 95 cannot beused is displayed on the screen of FIG. 17. For example, the Phoneportion is displayed gray (grayout).

Generally, the number (maximum number) of smartphones which can beregistered in master device 10 so as to use the monitoring systemfunction is also predefined. For example, in a case where the maximumnumber of smartphones which can be registered so as to use themonitoring system function is eight, and the number of smartphones whichcan be registered as slave devices is four, the number of smartphoneswhich can be registered in master device 10 so as to be limited to themonitoring system function is four. In a case where smartphones 50 ofthe maximum number which can be registered so as to use the monitoringsystem function have already been registered, master device 10 notifiessmartphone 50 that the smartphone cannot be registered.

Consequently, it is possible to efficiently use both of the fixedtelephone function and the monitoring system function via master device10 and thus to achieve the compatibility of a telephone function and asecurity function.

The number of salve devices related to the telephone function is eitherthe number of smartphones or the number of smartphones and typical slavedevices.

Although the various embodiments have been described with reference tothe drawings, needless to say, the present invention is not limited tosuch embodiments. It is obvious that a person skilled in the art canconceive of various modifications or alterations within the scoperecited in the claims, and thus it is understood that they naturallyfall within the technical scope of the present invention.

For example, in the above-described present embodiment, a descriptionhas been made of a case where the present invention is applied to amonitoring camera system, but the present invention is not limitedthereto and is applicable to, for example, a communication system inwhich a traveler who possesses a camera converses with a friend or thelike who possesses a portable terminal while viewing an image capturedon a journey or the like.

1. A monitoring camera system comprising: a monitoring camera; a masterdevice that, in operation, performs wireless communication with themonitoring camera and is connected to a fixed telephone network tocommunicate with other fixed telephones, wherein the master deviceincludes one or more slave ports at which one or more slave devices areregistrable; and a smartphone that includes a display/input unit andthat, in operation, performs wireless communication with the masterdevice via a wireless router, and is connected to other mobile phonesvia a mobile phone network, wherein, when a vacant slave port exists atthe master device, the master device registers the smartphone as a slavedevice capable of functioning as a fixed telephone and a monitoringsystem peripheral, and when a vacant slave port does not exist at themaster device, the master device registers the smartphone as amonitoring system peripheral incapable of functioning as a fixedtelephone, wherein, when the registered smartphone receives a useroperation instructive of monitoring image display, the registeredsmartphone transmits information regarding the user operation via thewireless router to the master device, and wherein the master device,according to the received information regarding the user operation,transmits image data from the monitoring camera via the wireless routerto the registered smartphone.
 2. The monitoring camera system of claim1, wherein when the master device registers the smartphone as amonitoring system peripheral incapable of functioning as a fixedtelephone, the master device transmits a notification indicative of thesmartphone's limited registration via the wireless router to thesmartphone.
 3. The monitoring camera system of claim 1, wherein a numberof smartphones registrable at the master device to function as amonitoring system peripheral is greater than a number of smartphonesregistrable at the master device to function as both a fixed telephoneand a monitoring system peripheral.
 4. The monitoring camera system ofclaim 3, wherein when a maximum number of smartphones registrable at themaster device to function as a monitoring system peripheral have beenregistered at the master device, the master device transmits anon-registrability notification to another smartphone that requestsregistration at the master device.
 5. The monitoring camera system ofclaim 1, wherein the master device and the monitoring camera performwireless communication with each other according to a DECT (DigitalEnhanced Cordless Telecommunications) communications protocol.
 6. Acommunication method used in a monitoring camera system, wherein themonitoring camera system includes: (a) a monitoring camera; (b) a masterdevice that, in operation, performs wireless communication with themonitoring camera and is connected to a fixed telephone network tocommunicate with other fixed telephones, wherein the master deviceincludes one or more slave ports at which one or more slave devices areregistrable; and (c) a smartphone that includes a display/input unit andthat, in operation, performs wireless communication with the masterdevice via a wireless router, and is connected to other mobile phonesvia a mobile phone network, the communication method comprising:registering the smartphone with the master device as a slave devicecapable of functioning as a fixed telephone and a monitoring systemperipheral when a vacant slave port exists at the master device,registering the smartphone with the master device as a monitoring systemperipheral incapable of functioning as a fixed telephone when a vacantslave port does not exist at the master device, receiving, at theregistered smartphone, a user operation instructive of monitoring imagedisplay, transmitting, from the registered smartphone that has receivedthe user operation, information regarding the user operation, via thewireless router, to the master device, and transmitting, from the masterdevice that has received the information regarding the user operation,image data from the monitoring camera, via the wireless router, to theregistered smartphone.
 7. The communication method of claim 6, furthercomprising: transmitting, from the master device that has registered thesmartphone as a monitoring system peripheral incapable of functioning asa fixed telephone, a notification indicative of the smartphone's limitedregistration, via the wireless router, to the smartphone.
 8. Thecommunication method of claim 6, wherein a number of smartphonesregistrable at the master device to function as a monitoring systemperipheral is greater than a number of smartphones registrable at themaster device to function as both a fixed telephone and a monitoringsystem peripheral.
 9. The communication method of claim 8, furthercomprising: transmitting, from the master device that receives aregistration request from a smartphone, a non-registrabilitynotification back to the smartphone when a maximum number of smartphonesregistrable at the master device to function as a monitoring systemperipheral have already been registered at the master device.
 10. Thecommunication method of claim 6, wherein the master device and themonitoring camera perform wireless communication with each otheraccording to a DECT (Digital Enhanced Cordless Telecommunications)communications protocol.
 11. A communication method used in a monitoringcamera system, wherein the monitoring camera system includes: (a) amonitoring camera; and (b) a master device that, in operation, performswireless communication with the monitoring camera and is connected to afixed telephone network to communicate with other fixed telephones,wherein the master device includes one or more slave ports at which oneor more slave devices are registrable, the communication methodcomprising: registering a smartphone with the master device as a slavedevice capable of functioning as a fixed telephone and a monitoringsystem peripheral when a vacant slave port exists at the master device,wherein the smartphone includes a display/input unit and, in operation,performs wireless communication with the master device via a wirelessrouter and is connected to other mobile phones via a mobile phonenetwork, registering the smartphone with the master device as amonitoring system peripheral incapable of functioning as a fixedtelephone when a vacant slave port does not exist at the master device,receiving, at the registered smartphone, a user operation instructive ofmonitoring image display, transmitting, from the registered smartphonethat has received the user operation, information regarding the useroperation, via the wireless router, to the master device, andtransmitting, from the master device that has received the informationregarding the user operation, image data from the monitoring camera, viathe wireless router, to the registered smartphone.
 12. The communicationmethod of claim 11, further comprising: transmitting, from the masterdevice that has registered the smartphone as a monitoring systemperipheral incapable of functioning as a fixed telephone, a notificationindicative of the smartphone's limited registration, via the wirelessrouter, to the smartphone.
 13. The communication method of claim 11,wherein a number of smartphones registrable at the master device tofunction as a monitoring system peripheral is greater than a number ofsmartphones registrable at the master device to function as both a fixedtelephone and a monitoring system peripheral.
 14. The communicationmethod of claim 13, further comprising: transmitting, from the masterdevice that receives a registration request from a smartphone, anon-registrability notification back to the smartphone when a maximumnumber of smartphones registrable at the master device to function as amonitoring system peripheral have already been registered at the masterdevice.
 15. The communication method of claim 11, wherein the masterdevice and the monitoring camera perform wireless communication witheach other according to a DECT (Digital Enhanced CordlessTelecommunications) communications protocol.